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We determine the complexity of several constraint satisfaction problems using the quantum adi- 
abatic algorithm in its simplest implementation. We do so by studying the size dependence of the 
gap to the first excited state of "typical" instances. We find that at large sizes N, the complexity 
increases exponentially for all models that we study. We also compare our results against the com- 
plexity of the analogous classical algorithm WalkSAT and show that the harder the problem is for 
the classical algorithm the harder it is also for the quantum adiabatic algorithm. 



PACS numbers: 75.10.Nr, 03.67.Lx, 03.67.Ac, 64.70.Tg 



I. INTRODUCTION 

Theoretical research on quantum computing is moti- 
vated by the exciting possibility that quantum comput- 
ers are inherently more efficient than classical computers 
due to the advantages that the laws of quantum mechan- 
ics provide, such as superposition, interference and en- 
tanglement. Besides the great effort of research towards 
the physical realization of these devices, a lot of activ- 
ity has been devoted to the development of algorithms 
that could use quantum properties to achieve better ef- 
ficiency in performing computational tasks with respect 
to classical devices. 

Perhaps the best example to date for the superiority of 
quantum computers over classical ones is given by Shor's 
algorithm [l| for integer factorization, which solves the 
problem in polynomial time, whereas the best classical 
algorithm takes a time which is exponential in (a frac- 
tional power of) the problem size. 

A rather general approach to solve a broad range of 
hard optimization problems using a quantum computer 
has been proposed by Farhi et al. [1] . Within the frame- 
work of this new approach, which was given the name the 
Quantum Adiabatic Algorithm (QAA), the solution to an 
optimization problem is encoded in the ground state of 
a Hamiltonian H p . To find the solution, the QAA pre- 
scribes the following course of action. As a first step, the 
system is prepared in the ground state of another Hamil- 
tonian Hd, commonly referred to as the driver Hamilto- 
nian. The driver Hamiltonian is chosen such that it does 
not commute with the problem Hamiltonian and has a 
ground state which is fairly easy to prepare. As a next 
step, the Hamiltonian of the system is slowly modified 
from Hd to H p , using the linear interpolation, i.e. 



H(s)=sH p + (l-s)H d , 



(1) 



where s(t) is a parameter varying smoothly with time, 
from at t = to 1 at the end of the algorithm, t — T. 
If this process is done slowly enough, the adiabatic the- 
orem of Quantum Mechanics (see, e.g., Refs. [|| and 
ensures that the system will stay close to the ground 
state of the instantaneous Hamiltonian throughout the 



evolution, so that one finally obtains a state close to the 
ground state of H p . At this point, measuring the state 
will give the solution of the original problem with high 
probability. 

The running time T of the algorithm determines the 
efficiency, or complexity, of the QAA. An upper bound for 
the complexity can be given in terms of the eigenstates 
{\n}} and eigenvalues {E n } of the Hamiltonian, by 

|max s Vi (s)| 



(AE n 



(2) 



where A_E m j n is the minimum of the first excitation gap 
AE m i n = mm s AE with AE — E\ — E , and V n o — 
(0\dH/ds\n). 

Typically, matrix elements of H scale as a low polyno- 
mial of the system size N, and the question of whether 
the complexity depends polynomially or exponentially 
with N therefore depends on how the minimum gap 
AE m i n scales with N. This means that if the gap be- 
comes exponentially small at any point in the evolution, 
then the computation requires an exponential amount of 
time, rendering the QAA inefficient. The dependence of 
the minimum gap on the system size for a given problem 
is therefore a central issue in determining the complexity 
of the QAA. 

The most interesting unknown about the QAA to date 
is thus whether or not it could solve in polynomial time 
"hard" sets of problems - those which belong to the NP- 
complete category Q and for which all known algorithms 
take an exponential amount of time (exponential com- 
plexity) at least in the worst case. While early studies 
of the QAA done on very small systems (N < 24) 0, H[ 
provided some preliminary numerical evidence that the 
time required to solve one such NP-complete problem 
does scale only polynomially, roughly as N 2 , several later 
studies gave evidence that this may not be the case. 

Refs. p, Q show that adiabatic algorithms can fail if 
one does not choose the initial Hamiltonian carefully by 
taking into account the structure of the problem. Alt- 
shuler et al. also argued that adiabatic quantum op- 
timization will fail in general for random instances of NP- 
complete problems. However, the arguments of Altshuler 
et al. have been criticized by Knysh and Smelyanskiy fTll j . 
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In addition, Young et al. [l2|, |l3[ recently examined 
the l-in-3 "constraint satisfaction" , or SAT, problem (to 
be explained in the next section) and showed that very 
small gaps could appear in the spectrum of the Hamilto- 
nian due to an avoided crossing between the ground state 
and another level corresponding to a local minimum of 
the optimization problem. This 'bottleneck' was shown 
to appear in a larger and larger fraction of the instances 
as the problem size N increases, indicating the existence 
of a first order quantum phase transition. This leads 
to an exponentially small gap of a typical instance, and 
therefore also to the failure of adiabatic quantum opti- 
mization. Other studies that considered this model have 
found an exponential complexity [3, [l5| for particularly 
hard instances of small size. 

It is not yet clear however to what extent the above 
behavior found for l-in-3 SAT is general and whether it 
is a feature inherent to the QAA that will plague most 
if not all problems fed into the algorithm or something 
far more restricted than this. Previous work (l6l - fl8j had 
argued that a first order quantum phase transition oc- 
curs for a broad class of random optimization models. 
To gain further insight into this matter we study here 
three optimization problems which had previously been 
suggested [l?], OS as good potential candidates for 
detailed investigation. 

The problems we study are of the "constraint satis- 
faction" type. For these, one asks a questions for which 
there is a "yes" or "no" answer, namely whether there is 
an assignment of ./V bits which satisfies all of M logical 
conditions (clauses). An energy is assigned to each clause 
such that it is zero if the clause is satisfied and positive 
if it is not. 

The first two problems we focus on in this paper are 
"locked" problems - a term first introduced by Zdeborova 
and Mczard [ljl [2(| for problems with instances hav- 
ing the following two properties: (i) every variable is 
in at least two clauses, and (ii) one can not get from 
one satisfying assignment to another by flipping a single 
bit. In fact, it was argued that typically order In TV bits 
needs to be flipped to go from one solution to another. 
These locked problems have several properties that make 
them eminently suitable as benchmarks. They are an- 
alytically "simple" (or at least simpler than previously 
studied models such as random K-SAT), but are com- 
putationally hard. Also, fluctuations between instances 
are smaller than with "unlocked" problems. Specifically, 
we study here the complexity of the QAA for the locked 
l-in-3 SAT and locked 2-in-4 SAT models which belong 
to the NP-complete category. 

In addition, we also compare our results with those of 
a third model, 3-regular 3-XORSAT, already considered 
by Jorg et al. 17 1, and Far hi et al. [21(. As we shall see, 



this model, while belonging to the P complexity class 
(i.e., it could be solved in polynomial time) is very hard 
to solve computationally by general purpose algorithms. 

We study these models by analyzing the size depen- 
dence of the typical gap by means of quantum Monte 



Carlo (QMC) simulations. The plan of this paper is as 
follows: Section [TT| describes the three models that will 
be studied. In Sec. lIIII we discuss the manner in which we 
obtain our results. These results are presented in Sec. IIVI 
and our conclusions are summarized in Sec. W\ 



II. MODELS 

We consider problems of the "constraint satisfaction" 
type, in which there are N bits (or equivalently, Ising 
spins) and M "clauses" where each clause is a logical 
condition on a small number of randomly chosen bits. A 
configuration of the bits (spins) is a "satisfying assign- 
ment" if it satisfies all the clauses. 

In encoding this type of problem as a quantum Hamil- 
tonian, each bit variable is represented in the Hamilto- 
nian by the z-component of a Pauli matrix, a~f, where 
i labels the spin. Each clause is thus converted to an 
energy function which depends on the spins associated 
with the clause, such that the energy is zero if the clause 
is satisfied and is positive (in our case, one) if it is not. 
The general structure of the problem Hamiltonian H p is 
therefore 



71/ 



H, 



(3) 



where a is the clause index and H a is the energy associ- 
ated with the clause and involves the spins belonging to 
it. 

Clearly, it is easy to satisfy all clauses if the ratio 
a = M/N is small enough. In fact, one expects an expo- 
nentially large number of satisfying assignments in this 
region. Conversely, if M/N is very large, with high prob- 
ability there will be a conflict between different clauses. 
Hence there is a "satisfiability transition" at some value 
a s where the number of satisfying assignments goes to 
zero. It is particularly hard to solve satisfiability prob- 
lems close to the transition [22], so we will work in this 
region. 

Furthermore, when studying the efficiency of the QAA 
numerically @, [lU, Ha ], it is convenient to consider 
instances with a unique satisfying assignment (USA), 
which, of course, forces the system to be close to the 
transition. Considering instances with a USA is par- 
ticularly advantageous for locked problems. While for 
unlocked problems the entropyof solutions at the satis- 
fiability threshold is positive 1231. for locked problems it 
approaches zero continuously [l9l[20|. This means that 
while solutions with USA are rare for unlocked problems, 
they are expected to be among the 'typical' instances 
for locked problems and therefore locked problems have 
the advantage that instances with a USA should be a 
good representation of randomly chosen instances. In- 
deed, this is supported by a recent numerical study [24j 
that found that the probability of a USA only decreases 
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locked l-in-3 


locked 2-in-4 


N 


M 


M 


16 


13 


11 


24 


- 


17 


32 


25 


23 


40 




28 


48 


38 


34 


64 


51 




96 


76 





TABLE I: Values of M and N for the locked instances. 

slowly with N and appears to tend to a nonzero value as 
N -)• oo. 

We now discuss the different models that will be inves- 
tigated in this paper. 



A. Locked l-in-3 SAT 

In the l-in-3 SAT problem each clause consists of three 
bits chosen randomly, and the clause is satisfied if one of 
the bits is one and the others are zero. Here we fix the 
ratio M/N to be the critical value for the satisfiability 
transition. According to Table I of Ref. [2(| , this is equal 
to a s = 0.789. Since M has to be an integer we take M 
to be the nearest integer to a s N, see Table |TJ Note that, 
if the sites are chosen at random to form the clauses, the 
distribution of the degree of the sites (i.e., the number 
of clauses involving a site) would be Poissonian. How- 
ever, locked instances have a minimum degree of two, so 
instead we use a truncated Poissonian distribution [2(| 
which is Poissonian except that the probabilities for zero 
and one are set to zero. 

We study instances with a unique satisfying assign- 
ment (USA). For these instances the gap to the first ex- 
cited state is of order unity at s = 1 (and also of order 
unity at s — 0) so the gap has a minimum whose value 
is related to the complexity. For instances with many 
satisfying assignments the ground state of the problem 
Hamiltonian is degenerate and so the gap to the first 
excited state decreases to zero as s — > 1. Hence this 
gap would give no information about the computer time 
needed to determine whether there is a state with zero 
energy. 

The energy of a clause for the locked l-in-3 problem is 
given by: 



1 



5 - °ai ~ G l- 2 - a a a 



(4) 



Q „Z „Z „Z 



where a denotes the index of the clause and the 
(i = 1,2,3) label the participating spins. With this 
Hamiltonian, the energy is zero if the clause is satisfied 
and is one otherwise. 



B. Locked 2-in-4 SAT 

We also consider locked 2-in-4 instances, in which a 
clause has four bits, and is satisfied if two are zero and 
two are one. Unlike the locked l-in-3 SAT model dis- 
cussed above, this model has a symmetry under flipping 
all the bits. 

We fix the ratio M/N to be the critical value for the 
satisfiability transition. According to Table I of Ref. [2(| , 
this is equal to a s — 0.707. Again, since M has to be an 
integer we take M to be the nearest integer to a s N, see 
Table i 

In this problem, the energy of a clause is given by: 



H a = 



l( 



5 + « 



o„z _Z —Z _z 



(5) 



where, as before, a denotes the index of the clause and 
the at (i = 1,2,3,4) label the participating spins. For 
this energy term, a satisfied clause has zero energy and 
an unsatisfied one has energy one. 

Because of bit-flip symmetry the energy of a state of 
the problem Hamiltonian is the same as that of the state 
obtained by flipping all the bits. Hence, when we refer to 
an instance with a "unique" satisfying assignment (USA) 
for the locked 2-in-4 problem, we will ignore states re- 
lated by symmetry (so the true ground state degeneracy 
is actually two, not one). 



C. 3-regular 3-XORSAT 

Another problem we discuss here is the 3-regular 3- 
XORSAT problem, already considered by Jorg et al. [ItJ 
and Farhi et al. [2l|. In the 3-XORSAT problem, three 
bits are chosen to form a clause and the clause is satisfied 
if their sum (mod 2) is a specified value (either or 1). 
Alternatively, in terms of spins, the clause is satisfied if 
the product of the three erf's is a specified value (either 
-1 or 1). 

We will consider here the "3-regular" case where every 
bit is in exactly three clauses, a model which turns out 
to be precisely at the satisfiability threshold. Note that 
this implies M — N. Again, the problem to be solved is 
whether there is an assignment of the bits which satis- 
fies all the clauses. Interestingly, since this problem just 
involves linear algebra (mod 2), the satisfiability prob- 
lem can be solved in polynomial time using, for exam- 
ple, Gaussian elimination. However, as is already well 
known (see, e.g., (2f| [26j]) and will also become evident 
soon, the problem is very hard for general purpose algo- 
rithms. Furthermore, if there is no satisfying assignment, 
no known polynomial time algorithm will determine the 
minimal number of unsatisfied clauses, a problem known 
as MAX-XORSAT. 

As usual, we consider instances with a USA. Fortu- 
nately, these are a nonzero fraction, about 0.285 [17| . of 
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the total, so the USA instances should be a good rep- 
resentation of randomly chosen ones. For XORSAT in- 
stances with a USA, it is not difficult to show that one 
can gauge transform any instance into one in which the 
sum of the bits of every clause is equal to (mod 2). 
The USA is then all bits equal to 0, (a "ferromagnetic" 
ground state in statistical physics language). Although 
this ground state is "trivial" , we shall see that it is very 
hard to find using general purpose algorithms including 
the QAA. 

The energy of a clause in this model is: 



„z ^Z ^z \ 



(6) 



where again a denotes the index of the clause and the a,i 
(i — 1, 2, 3) label the participating spins. 
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D. The driver Hamiltonian 

Before moving on, we note that the driver Hamiltonian 
we choose here is perhaps the simplest possible choice, 



FIG. 1: (Color online) Gap to the first excited state as a 
function of s for one instance of the locked l-in-3 SAT prob- 
lem. The line is a quadratic fit to the data points from which 
the location, s = 0.523, and value, AE m i n — 0.207, of the 
minimum gap are obtained. Here, TV = 64 and /3 = 1024. 



H d =-Y^{l-af) t (7) 

i 

where erf is the x-component Pauli matrix acting on spin 
i. This corresponds to a transverse field of equal size on 
all sites. Its ground state is a uniform superposition of 
all 2 N states of the computational (i.e. a z ) basis. 



III. METHOD 

As was already mentioned, the complexity of the 
QAA algorithm is determined by the size dependence 
of the "typical" minimum gap of the problem. Follow- 
ing Refs. [IH and [Hj], we analyze the size-dependence 
of these gaps for each of the problems discussed in the 
previous section by considering typically 50 instances for 
each size, and then extracting the minimum gap for each 
of them. As a next step, we take the median value of the 
minimum gap among the different instances for a given 
size to obtain the "typical" minimum gap. 

To find the minimum gap for a specific instance of a 
specific problem, we perform quantum Monte Carlo sim- 
ulations for a range of s values that bracket the mini- 
mum gap. For each of the studied s values we extract 
the gap and interpolate the minimum value using a sim- 
ple quadratic fit. An illustrative example of this is given 
in Fig. rjj 

In cases where we find that the mesh of s values is 
either too crude or does not bracket the minimum gap, 
a second round of simulations, with a more appropriate 
mesh of s values, is launched. 



A. The quantum Monte Carlo technique 

To study the behavior of the typical minimum gap for 
large (N > 24) system sizes for which exact diagonal- 
ization routines are unfeasible, we employ a continuous- 
time quantum Monte Carlo technique. As the name indi- 
cates, this technique is based on sampling the 2 N states 
of the Hilbert space, so there are therefore statistical er- 
rors stemming from the nature of the procedure. How- 
ever, Monte Carlo methods provide the only numerical 
method available for investigating large system sizes. 

The specific method we use in this study is known as 
the stochastic series expansion (SSE) algorithm (2^, [28[ 
which involves a Taylor series expansion of the partition 
function Tr , [e _ ^ ff ] and uses a discrete representation of 
continuous imaginary time. This discretization however 
does not introduce errors into the algorithm as is the case 
in the alternative path-integral formulation, where one 
usually performs a Trotter-t ype discretization of imagi- 
nary time, see e.g. Refs. [l2l Tl3jj . though formulations in 
continuous imaginary time also exist |29l . I30T ] . Here (3 is 
the inverse temperature \/T (in our units fcs = 1). 

The SSE algorithm has several properties that are very 
useful in addressing the problems we focus on in this 
study. Firstly, it works in continuous imaginary time 
as discussed above. Secondly, it allows not only local 
updates of system configurations but also global clus- 
ter updates, which in most cases prove to be more effi- 
cient than single-spin-fhp updates. These global updates 
are achieved by dividing the configurations of the system 
produced by the QMC into clusters and then flipping 
a fraction of them within each sweep of the simulation 
[3lj . An important bonus of cluster updates is the ex- 
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istence of "improved estimators" for determining time- 
dependent correlation functions, for which the signal to 
noise is much better than with conventional measure- 
ments. 

In addition, we speed up equilibration by implementing 
"parallel tempering" [32j , where simulations for different 
values of s are run in parallel and spin configurations 
with adjacent values of s are swapped with a probability 
satisfying the detailed balance condition. Traditionally, 
parallel tempering is performed for systems at different 
temperatures, but here the parameter s plays the role of 
(inverse) temperature. 

We extract the gap from imaginary time-dependent 
correlation functions. However, in the locked 2-in-4 case, 
where the problem has bit-flip symmetry, this is tricky 
using the standard SSE algorithm and, as discussed next, 
we will use a different approach. 

The difficulty arises for the following reason. Eigen- 
states of the Hamiltonian are either even or odd un- 
der bit-flip symmetry (in particular, the ground state is 
even). In the s — > 1 limit, states occur in even-odd pairs 
with an exponentially small gap (see Fig. [5] for an illus- 
tration). Therefore, the quantity of interest is the gap 
to the first even state. We consider correlation functions 
of even quantities, so there are only matrix elements be- 
tween states of the same parity. However, the lowest odd 
level becomes very close to the ground state near where 
the gap to the first even excited state has a minimum, see 
Fig. [2j Hence this lowest odd state becomes thermally 
populated, with the result that odd-odd gaps are present 
in the data as well. 

We have eliminated these undesired contributions by 
projecting out the symmetric subspace of the Hamilto- 
nian. A way of doing this projection at zero temperature 
was proposed independently by Eddie Farhi [33| and An- 
ders Sandvik [34|. In standard quantum Monte Carlo 
simulations one imposes periodic boundary conditions in 
imaginary time r at r = and /3. To project out the 
symmetric subspace one imposes, instead, free boundary 
conditions [35] at r = and (3. The properties of the 
symmetric subspace can then be obtained, for /3 — > oo, 
by measurements far from the boundaries. We have in- 
corporated this idea into the SSE scheme, and use this 
modified algorithm in the simulations of the locked 2-in-4 
problem. 

To verify that our implementations of the SSE methods 
are accurate, we have compared their results with corre- 
sponding exact diagonalization results on small system 
sizes. The results agree within the error bars. A compar- 
ison of the gap is shown in Fig. [5] The careful will reader 
note that the QMC data is slightly but consistently above 
the diagonalization results. This is due to contributions 
from higher excited states at short times which increase 
the value of the time-dependent correlation function used 
to extract the gap in this limit, see Fig. [2] and Sec. IIIIBl 
The effect is small even for the N — 16 data shown in 
Fig. [21 and we expect it to be smaller still for larger sizes 
near the minimum gap, since the gap is smaller so there 
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FIG. 2: (Color online) Energy gaps to even (solid, red) and 
odd (dashed, blue) excited states for an N = 16 instance 
of the locked 2-in-4 problem, which has bit-flip symmetry as 
discussed in the text. The dotted line shows a characteristic 
value of another important energy scale in the problem, tem- 
perature. In the region where the gap to the first even state 
has a minimum, the gap to the first odd state becomes very 
small and is inevitably thermally populated. Hence, odd-odd 
gaps appear in this region as well as even-even gaps. This 
is the reason why we use a non-standard Monte Carlo algo- 
rithm for this problem which projects out the symmetric sub- 
space, so only even-even gaps are present in the data. The 
figure also shows the gap obtained from the even-subspace 
projected QMC in vicinity of the minimum. It agrees with 
exact diagonalization within the error bars. 

is a larger region with straight-line behavior in plots like 
Fig. El 

B. Extraction of the system gap 

The gap of the system for a given instance and a given 
s value is extracted by analyzing measurements of (imag- 
inary) time-dependent correlation functions of the type 

C A {r) = (i(r)i(O)) - (Af , (8) 

where the operator A is some measurable physical quan- 
tity. In practice, we found it useful to construct super- 
positions of such correlation functions. Typically we use 
linear combinations of correlation functions of the opera- 
tors erf or erf <7 J where i and j run from 1 to N and label 
the spins. The evaluation of (A) 2 in the above equation is 
computed from the product (A)^ (A)^ where the two 
indices correspond to different independent simulations 
of the same system. This eliminates the bias stemming 
from straightforward squaring of the expectation value. 

In the low temperature limit, AE <C T where AE = 
Ei — Eq, the system is in its ground state so the 
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FIG. 3: (Color online) A log-linear plot of a time dependent 
correlation function for an instance of the locked l-in-3 SAT 
problem with N — 64 spins, /3 — 1024, near the minimum gap 
at s = 0.54. The energy gap is the negative of the slope at 
large values of imaginary-time r. A fit gives AE — 0.037. 

imaginary-time correlation function is given by 

C A (r) = £ |(0|i|m)| 2 (e-AE m r + e -AE mif) -^ (g) 

TCI — 1 

where AE m — E m — E$. At long times, r, the correlation 
function is dominated by the smallest gap, AE = AE\ : 
(as long as the matrix element |(0|^4|1)| 2 is nonzero). On 
a log-linear plot Ca(t) then has a region where it is a 
straight line whose slope is the negative of the gap. This 
can therefore be easily extracted by simple linear fitting. 

An illustration of the above procedure is depicted in 
Fig. [3] showing one of the correlation functions measured 
and analyzed for the locked l-in-3 problem for N = 64, 
6 = 1024 and s = 0.54. The gap in this case is AE = 
0.037. 



FIG. 4: (Color online) Median minimum gap on a log-linear 
scale for the locked l-in-3 problem. The straight-line fit is 
good indicating the exponential complexity of the QAA for 
this problem. 
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IV. RESULTS 



A. Results from the QAA 



FIG. 5: (Color online) Median minimum gap on a log-log 
scale for the locked l-in-3 problem. The straight-line fit is ex- 
tremely poor indicating that the minimum gap for this prob- 
lem is not polynomial in the system size. 



We show results for the median minimum gap as a 
function of size for the locked l-in-3 problem in Fig. 0] 
(log-lin) and Fig. [5] (log- log). A straight line fit works 
very well for the log-lin plot (goodness of fit parameter 
Q = 0.26) but very poorly for the log-log plot (Q = 3.8 x 
10~ 12 ). This provides strong evidence that the minimum 
gap is exponentially small in the system size, and so the 
complexity of the QAA (at least in the simplest version 
considered here) is exponentially large in the system size. 

The corresponding results for the locked 2-in-4 prob- 
lem are shown in Fig. [5] (log-lin) and Fig. [7] (log- log). A 



straight line fit works very well for the log-lin plot (Q = 
0.19) but poorly for the log-log plot (Q = 5.9 x 10~ 4 ). 
This provides strong evidence that the minimum gap is 
exponentially small in the system size. 

The 3-regular 3-XORSAT problem has been studied 
by Jorg et al. [17| who determined the minimum gap 
for sizes up to N — 24 by diagonalization, and Farhi 
et al. 2_l| who extended the range of sizes up to N = 
40 by quantum Monte Carlo simulations. The two sets 
of results agree and provide compelling evidence for an 
exponential minimum gap. Below we will compare the 
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FIG. 6: (Color online) Median gap on a log-linear scale for the 
locked 2-in-4 problem. The straight-line fit is good indicating 
the exponential complexity for this problem. 
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FIG. 7: (Color online) Median gap on a log-log scale for the 
locked 2-in-4 problem. The straight-line fit is poor indicating 
that the complexity for this problem is not polynomial. 

coefficient in the exponent found by Jorg et al. and Farhi 
et al. with that for the other models studied here and 
with results from a classical algorithm. 



model 


M(QAA) 


M(WalkSAT) 


Ratio 


locked l-in-3 SAT 
locked 2-in-4 SAT 
3-reg 3-XORSAT 


0.084(3) (this work) 
0.126(5) (this work) 
0.159(2) [21] 


0.0505(5) [24] 
0.0858(8) [24] 
0.1198(20) [24] 


1.66 
1.47 
1.32 



TABLE II: Values of fi, the coefficient of N in the exponen- 
tial complexity of the Quantum Adiabatic Algorithm (QAA), 
Eq. (|10p . versus that of the analogous classical algorithm 
WalkSAT, Eq. 1)111) . and the ratios between them, for the 
three problems studied here. The data is taken from the ref- 
erences shown. 

search algorithm known as WalkSAT 36], which is sim- 
ilar in spirit to simulated annealing in that both make 
moves which reduce the "energy" , but also sometimes 
make moves which increase it to avoid being trapped in 
the nearest local minimum. 

As discussed in Sec. HI Landau-Zener theory states 
that, for the QAA, the computation time is propor- 
tional to 1/A£^ lin (neglecting N dependence of matrix 



elements) and since we find that A.E n 
complexity can be written as 



-,-cJV 



the 



T oc e r 



(10) 



where /i = 2 c. 

In the WalkSAT algorithm, the running time is propor- 
tional to the number of "bit flips" the algorithm makes 
(for more details, the reader is referred to Ref [HI)- Writ- 
ing the median number of flips as 



A^flir 



oc e 



(11) 



we can now compare the exponent coefficients of the 
QAA versus those of WalkSAT. The latter were measured 
in Ref. [24| . For the convenience of the reader, the values 
of fx for both the QAA and WalkSAT are summarized in 
Table IE 

As the table indicates, the exponent coefficients ob- 
tained with WalkSAT are somewhat smaller than those 
of the QAA, suggesting that the latter algorithm, in the 
specific way it was implemented in this paper, is slightly 
less efficient than its corresponding classical one for these 
three problems, although a problem-by-problem compar- 
ison shows that the coefficients are fairly similar. It is 
also evident from the table that the harder the problem 
is for WalkSAT, the harder it also is for QAA. 



SUMMARY AND CONCLUSIONS 



B. Comparison with a classical algorithm 

Since the QAA is designed to serve as an efficient tool 
for solving hard optimization problems it is interesting to 
compare its efficiency with that of a classical algorithm. 

In Ref. [24| it was argued that a reasonable classical 
algorithm to compare with QAA is the heuristic local 



Using Quantum Monte Carlo (QMC) simulations, we 
studied the complexity of the Quantum Adiabatic Algo- 
rithm (QAA) for three constraint satisfaction problems, 
two of them in the NP complexity class - locked l-in-3 
SAT and locked 2-in-4 SAT - and one in the P com- 
plexity class - 3-regular 3-XORSAT. All three problems 
show exponential complexity (albeit with somewhat dif- 
ferent coefficients), i.e. the computation time required by 



8 



the QAA to reach the solution of the problem Hamilto- 
nian with high probability increases exponentially with 
the system size N. 

We have also compared the QAA complexities against 
these of an analogous classical algorithm, WalkSAT and 
show the results in Table [TX| Perhaps not surprisingly we 
find that the harder the problem is for WalkSAT, the 
harder it also is for the QAA. Moreover, it seems that 
the coefficients of N in the exponential in the expression 
for the complexity of the QAA, Eq. (fTt))) . are somewhat 
larger than those of WalkSAT, Eq. (fTTj) (with ratios rang- 
ing between about 1.3 and 1.7). 

Several interesting questions arise upon examining the 
results of this study, and which we believe would be in- 
teresting to study in future work. The first one has to do 
with the possibility of avoiding the exponentially small 
gap by repeatedly running the algorithm with different 
random values for the transverse fields (and clause costs) 
29]. It would also be interesting to look, more gener- 
ally, for better paths in Hamiltonian space, perhaps by 
adding additional terms in the Hamiltonian for interme- 
diate values of s, which would increase the minimum gap. 
In particular, can we find a clever way to optimize the 



path in Hamiltonian space "on the fly" during the simu- 
lation? 

While the study reported here used instances with a 
unique satisfying assignment (USA), in which case the 
gap to the first excited state has a minimum which is 
related to the complexity, it would be interesting to also 
consider random instances to see if those too have expo- 
nential complexity in QAA. However this is numerically 
more challenging. 
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